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Description 



^ “•^[00011 The present invention relates to a signal processor. T>ie invention concerns, joining refen*ed to herein as 
splicing, digital bit streams which are compressed. Embodiments of the invention described herein are concerned with 



5.;N'spficing digital video bitstreams which are compressed according to the MPEG-2 standard. 

The invention and its background will be discussed by way of example with reference to MPEG-2 video bit- 
streams. However the invention is not limited to MPEG-2. 

. [pbb3] MPEG-2 is well known from for example ISO/IEC/13818-2, and will not be described In detail herein. Splic- 
‘ ittg of video is well known. It is used in editing video. Splicing analogue signals Is relatively straight forward and can be 
10 r done at the boundary between adjacent frames, because each analogue frame contains the whole of the video infor- 
: ration of that frame independerrtly of other frames. (Splicing can be done similarly In the digital domain for both corr^ 
. pressed and uncompressed video data if all frames contain the whole video information of the frame.) 

^'y:[0004] MPEG-2 compressed video comprises groups of I, P and/or B frames known as GOPs, Groups of Pictures, 
arid B frames are well known. An I or Intra-encoded frame contains alt the information of the frame independently 
of any otherframe. A P frame In a GOP ultimately depends on an I frame and may depend on other P frames. A B frame 
of a GOP ultimately depends on an l-frame and may depend on P frames in the GOP. A B frame must not depend on 
; % another B frame. 

■ [0005] A GOP typically comprises 1 2 or 1 5 frames comprising at least one I frame and several P and B frames. To 
correctly decode a GOP requires all the frames of the GOP, because a large part of the video information required to 
20: decode a B frame in the GOP is in a preceding and/or succeeding frame of the GOP. Likewise a large part of the video 
. . information required to decode a P frame is in a preceding frame of the GOP. 

[0006] Thus if two different bit streams are spliced together in the compressed domain, the information necessary 
tb decode frames each side of the splice point is likely to be lost. 

. [0007] Many papers have been written concerning the splicing of compressed bitstreams, which is a well known 
: problem In MPEG. A paper “Flexible Switching and editing of MPEG-2 Video Bitstreams" by RJ. Brightwell, S.J. Dancer 
;';and M.J. Knee was published in "Atlantic Technical Papers 1996/1997" the preface to which is dated September 1 997. 
[0008] The paper discusses the problems of splicing MPEG-2 Video Bitstreams. Two bitstreams A and B to be 
spliced are decoded in respective decoders. A coder is switched from the decoder of A to the decoder of B at the splic- 
• &ig point. It discloses that near a splicing point where a bitstream A is replaced by a bitstream B, the following modifi- 
30 cations are made. 

[0009] "The picture type may be changed to provide a more suitable refresh strategy around the switch point In the 
example below, the first P-frame in bitstream B after the switch is converted to an l-frame to provide a full refresh early 
. In the new scene. Also, bitstream A contains an l-frame just before the switch point - as this is unnecessary, it is recoded 
as a P-frame to save bits. 
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4S [0010] Prediction modes and motion vectors may require modification to take into account any changes In the plc- 
. ture type on recoding, or to prevent any predictions being made across the switch on recoding. In the example above, 
macroblocks that originally used forward or bi-directional prediction for the B-frame following the switch point will be 
recoded using intra mode and backward prediction respectively. In addition, vectors are required for the l-frame that is 
recoded as a P-frame - these can be estimated from the vectors in surrounding frames, or taken from l-frame conceal- 
50 ment vectors that many MPEG-2 bitstreams carry. 

[0011] The quantisation parameters will be changed as part of the recoder's rate control strategy. As in a conven- 
tional coder, this aims to control the buffer trajectory of a downstream decoder to prevent under- or overflow, and to 
maintain the picture quality as high as possible. In addition, the rate control algorithm for the ATLANTIC switch uses the 
vbv_delay values in bitstreams A an B (which are carried in the infobus) to make the buffer trajectory for the switched 
55 bitstream identical to that for bitstream B (i.e. the one being switched to) at some future time. Depending on the relative 
vbv_delay values, this may happen soon after the switch, or a recovery period of a few GOPs may be required. When 
it has been achieved, the recoder's quantisation parameters are locked to those of bitstream B, and the switch becomes 
transparent. 



2 





EP 1 079 631 A1 



[0012] The quantisation parameters may also be changed to take advantage of effect know as temporal masking! 
This refers to the eye's inability to see moderate or even large amounts of noise around a scene ch€uige - typically 5 dB . 
of degradation in the frame after the switch cannot be seen - and allows the number of bits used for the frames veiy. 
close to the switch point to be reduced, allowing a shorter recovery period/ 

5 [0013] “Vbv-delay values* are measures of the number of bits in the buffer of the down stream decoder. The man- 

ner in which the "buffer trajectory* for the switched bitstream is made identical to that for bitstream B is not disclosed In ' 
the paper. It has been found in experiments by the present inventors that splicing bitstreams which have very large dif- 
ferences in VBV-delay values is problematic. 

[0014] It is desirable to make the buffer traj^ory for the switched bit stream Identical to that for the bitstream B ® 
10 (referred to herein as VBV_lock) even where the difference between the vbv-delay values of the streams is large. 

[0015] According to the present invention, there is provided a signal processor for splicing a compressed bitstreEvn V 
Bq to a compressed bitstream Aq, comprising 



IS 



20 



25 



30 



means for decoding the bitstreams Aq and Bq, switching means coupled to the decoding means for producing a ^ 
spliced bitstream C, comprising data from bitstream Bq spliced to data from bitstream Aq at a splice point, encodfrig- 
means for re-encoding the spliced bitstream C for supply to a downstream decoder having a downstream buffer, 
wherein the encoding means is controlled over a transitional region so that the occupancy of the downstream buffer 
varies over the transitional region from the occupancy of bitstream Ao to the occupancy of bitstream B© accorcfirigs.:. 
to a trajectory in which the rate of change or occupancy is limited to a predetermined maximum rate. * 

[0016] By limiting the rate of change of occupancy, and preferably by limiting the maximum change made at pred^ 

termined intervals, the downstream buffer neither under- nor over-flows. Furthermore limiting the rate of change more " 
evenly distributes the bits over the transitional region. In the preferred embodiments of the invention in which the dita; 
carried by the bitstreams is compressed video, the even distn'bution of bits creates a consistent signal to noise rtfio " 
across the transitional region. ‘ j 

[0017] It is also desired to determine whether VBV_lock is achieved or not at the end of the transitional region af\d 
whether to extend the transitional region if VBV_lock has not been achieved or has not been achieved precisely. ' ’ 
[001 8] According to another aspect of the invention, there is provided a signal processor for splicing a compressed 
bitstream B to a compressed bitstream A. each bitstream comprising groups (GOPs) of I, and P and/or B frames cw^’ , 
prising 



means for decoding the bitstreams /Vq and Bq, 

switching means coupled to the decoding means for producing a spliced bitstream C, comprising data from bit- 
35 stream Bq spliced to data from bitstream A^ at a splice point (SPLICE), and 



encoding means for re-encoding the spliced bitstream C for supply to a downstream decoder having a downstream 
buffer, wherein 

the encoding means is controlled over a transitional region so that the occupancy of the downstream buffer varied 
40 over the transitional region from the occupancy of bitstream Aq to the occupancy of bitstream Bq, 

the transitional region includes a transitional GOP extending from the splice point and of a length Which Is an Ififtlai 
prediction of the point in stream B at which the occupancy of stream C equals that of stream B, and occupancy Is ' 
changed at regular intervals in the GOP according to a trajectory so as to make the occupancy of stream C equal 
to that of stream B by the end of the GOP, 

45 a limit is applied to a change according to the trajectory which increases occupancy, and 

the amount by which a change would exceed the limit frf it were not limited) is compared at the end of the GOP wth .. 

a threshold and, if it exceeds the threshold, the transitional region is extended. - ‘ ^ 

‘ 

[0019] By monitoring the amount ( reduction_carry) by which a change would exceed the limit and comparing ft to 
50 the threshold, the encoding means can determine when VBVJock is achieved or not. This allows lock to be achier^ 
with large differences in occupancy between the bitstreams A and B. Preferably, if the limit is not exceeded, the limit Is 
progressively reduced as the GOP proceeds. That prevents large changes at the end of the GOP. Preferably, if a 
change reduces occupancy, it is averaged (canry_over) over the remainder of the GOP to offset any increases whfcft , 
may occur later in the GOP. In an embodiment, if lock is not exactly achieved stuffing bits are added to the transitional 
55 GOP to achieve precise lock. 

[0020] For a better understanding of the present invention, reference will now be made by way of example to the 
accompanying drawings, in which: 
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. 54 > ; Figure 1 IS a time chart illustrating the splicing of a bitstream Bq to a bitstream Aq in accordance with a first example 
of the present invention; 

Rgure 2 illustrates a portion R of the chart of Rgure 1 in more detail; 

Rgure 3 is a schematic block diagram of an illustrative signal processor according to the present Invention and 
operating as illustrated in Rgures 1 and 2; 

: ^ Rgure 4 is a time chart illustrating the splicing of a bitstream Bq to a bitstream Aq in accordance with a second 
example of the present invention; 

. ; Rgure 5 illustrates a portion R of Rgure 4 in more detail; 

/ ; < Rgure 6A Is a schematic block diagram of an illustrative signal processor according to the invention and operating 
- as illustrated in Rgures 4 and 5; 

Rgure 6B shows a modification of Figure 6A; 

7^ V Rgure 7 shows illustrative GOPs in display order and the application of illustrative picture type decisions; 

Rgure 8 shows the GOPs of Rgure 4 in processing order; 

" Rgures 9 to 1 1 show illustrative values of VBV occupancy; and 
IS Rgures 12A, B and C are a flow diagram illustrating an example of modification of occupancy in the transitional 
. : . region. 

Transcoding Parameters 

20 ■ ’ I frames have the following transcoding parameters which are well known in MPEG. 

■ V [0022] DCTJType, Q and Q_Matrix which are reused in embodiments of the present invention described hereinbe- 

low. These parameters are reused in the recoding of I frames with reuse of parameters. 

[0023] P and B frames have the parameters DCT_Type, Q. Q_Matrix, Pred_Type, MB_Mode and Motion Vectors. 
These parameters are reused in the recoding of P and B frames with reuse of parameters. These parameters are recal- 
when fully recoding all frames. 

First Example 

[0024] Refem'ng to Rgures 1, 3 and 7, two bitstreams A© and Bq are MPEG-2 encoded with GOPs comprising 12 
30 frames. In this example the bitstreams Aq and Bq have the same GOP structure: 

as shown in Figure 7. However the bitstreams may have any other GOP structure allowed by MPEG-2. The two 
35 bitstreams Aq and Bq may have different GOP structures. For ease of explanation it is assumed the bitstreams Aq and 
, Bo have the same GOP structure as shown In Rgure 7. 

' [0025] It is desired to replace bitstream Aq by bitstream Bq. As shown in Figure 1 . initially Aq is provided to the proc- 
essor. It is routed in the processor P of Rgure 3 from input Aq to contact Aq of switch where it Is fed, unchanged to, 
for example, a downstream decoder 2. In decoder 2 it is decoded for display. Downstream decoder 2 may be in, for 
40 example, a domestic television receiver. Processor P may be in a studio. 

[0026] When an operator decides to splice bitstreams Bq and Aq, the operator operates the switch SI and a switch 
S2 so that Aq is routed through decoder A, encoder 4 and via contact C of switch SI to the downstream decoder 2. 
[0027] The bitstream Aq is decoded in decoder A and re-encoded in encoder 4. The MPEG -2 parameters are 
derived from the decoder A by a control processor 6 and reused in the encoder 4, so that the decoding and re-encoding 
45 is as loss-less as possible. (There may be some loss because the DCT rounding process can cause the DCT process 
to be not transparent.) 

[0028] Before the splice point bitstream Bq is also decoded in decoder B. 

[0029] The processor P has sufficient storage (not shown) associated with decoders A and B to store for example 

30 compressed frames. 

50 [0030] A splice point SPLICE is chosen. At the splice point switch S2 selects the decoder B and decoded bitstream 

B is fed via the encoder 4 to the contact C of switch SI . In the example of Rgures 1 and 7, full recoding, that is without 
re-use of the MPEG parameters, begins on the bitstream Aq 5 frames before the splice point SPLICE. The reason for 
this will be explained below. After the splice, bitstream Aq is irrelevant except that some frames of Aq after the splice 
may be needed to decode frames of Aq occurring before the splice. 

55 [0031] After the splice point SPLICE, the bitstream Bq is fully recoded for a transition period during which VBVJock 

Is achieved as will be explained below. Once VBVJock is achieved, recoding of bitstream Bq continues but with re-use 
of the MPEG parameters derived from the original bitstream Bq. 

[0032] After a short interval of recoding of Bq with re-use of the MPEG parameters, switch SI selects contact Bq 
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and thus the original bitstream Bq, by-passing the decoder B and encoder C. 

Second Example 

5 [0033] Referring to Rgures 4. 6A and 7, two first generation (Gent) bitstreams Aq and Bq are MPEG-2 encoded >: 

with GOPs comprising 1 2 frames. In this example the bitstreams Aq and Bq have the same GOP structure: ■ 

ibbpbbpbbpbb 

3S shown in Rgure 7. However the bitstreams may have any other GOP structure allowed by MPEG-2. The tyw 
bitstreams Aq and Bq may have different GOP structures. For ease of explanation it is assumed the bitstreeims Ao.andTr V 
Bq have the same GOP structure as shown in Figure 7. 

[0034] It is desired to replace bitstream Aq by bitstream Bq. As shown in Figures 4 and 6A, initially Aq and Bq are 
decocted In decoders 1 and 3. The decoded bitstreams are recoded in recoders 8 and 10 as second generation (Geh2) . 
15 bitstreams Aj and B| When decoding and recoding Aq and Bq as A^ and B|, the MPEG parameters of all frames of the 
original bitstreams Aq and Bq are retained in association with the recoded corresponding frames of A| and B|. I frames 
of Aq and Bq are recoded as I frames of the bitstreams A| and B| using the same parameters they had In Aq and Bq. P ' 
and B frames of Aq and Bq are recoded as I frames in A| and B| but their original MPEG parameters are retained. The 
MPEG parameters are retained in the recoded bitstream A|, B| as, for example, user data. 

20 [0035] When an operator decides to splice the recoded bitstreams B| and A|, the operator operates the switch S2 ^ 

so that Aj is routed to a store 12 up to the splice point and B| is routed to the store 12 after the splice point, so that store ^ 

1 2 stores the spliced bitstream A|/Bi with a splice point between the a frame of A| and a frame of B|. 

[0036] The spliced bitstream A/Bj is decoded to base band and re-encoded in an encoder 4 as a third generation 
bitstream (Gen3) GOP C of the form shown in Rgure 7. 

25 [0037] In a preferred embodiment shown In Rgure 6B the bitstreams are stored in respective stores 14 and 16 

upstream of the switch S2 before they are spliced. The splbed bitstream A/B| is stored in another store 12. The stor^ 

14. 16 and 12 may be digital Video Tape Recorders, disc recorders and/or I frame servers for example. 

[0038] Referring to Figure 4 the splice point SPLICE is indicated. At the splice point switch S2 switches from, for . 
example, bitstream A^ to bitstream B^. When the spliced bitstreams are to be re-encoded they are fed to the encdder 
30 4. In the example of Figures 4,6 and 7, full recoding, that is without re-use of the MPEG parameters, takes place in a 

transition region beginning on the bitstream A| 5 frames before the splice point SPLICE. The reason for this will be 
explained below. 

[0039] Before the beginning of the transition region (i.e. more than 5 frames before SPLICE) the bitstream Ay Is ' 
recoded reusing the MPEG parameters derived from the original bitstream Aq. f . 

35 [0040] After the splice point SPLICE, the bitstream B| is fully recoded for the remainder of the transition period dur- 

ing which VBVJock Is achieved as will be explained below. Once VBVJock is achieved, recoding of bitstream B| con- 
tinues but with re-use of the MPEG parameters derived from the original bitstream Bq. j 

[0041] The spliced and recoded bitstream C produced by processor P and encoder 4 are fed to a downstream 
decoder 2 where the bitstream C is decoded for display for example. Downstream decoder 2 may be in, for example, a 
40 domestic television receiver. Processor P may be in a studio. ' - 

[0042] In Figures 6A and 6B the spliced bitstream Aj/Bi is stored in the l-frame store 12 before being recoded A • 
marker marking the splice point is recorded in the bitstream, for example in the user bits. " 

[0043] As shown in Figures 1 and 4, for both the first and second examples there is a transitional region which . 
includes the splice point SPLICE during which the occupancy for the bitstream C is controlled to prevent under- and ' * 
45 over-flow of the buffer of the downstream decoder 2. ’ ' ' . 

[0044] The methods of control discussed in the following discussion apply equally to both examples. However, it will; 
be appreciated that ' • 

a) in the first example it is the original bitstreams Aq and Bq which are being re-encoded by the encoder 4; whereas 
50 b) in the second example it Is the I frame bitstreams A| and B| which are being re-encoded by the encoder 4. ^ 

[0045] However, the re-erx:oding of the frames of the bitstreams A| and Bj is dependent on corresponding frarn^ . 
of the bitstreams Aq and Bq from whch they are derived. Thus, in the following reference is made only to the frames'of ' 
the original bitstreams Aq and Bq. The following discussion applies to the frames of the bitstreams A| and B| which cor- 
55 respond to the frames of the bitstreams Aq and Bq, with the result that the effect of recoding is the same as if the bft- 
stream had not been re-coded as I frames (apart from some losses due to the additional recoding and decoding to and . 
from I frames). ^ 
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Picture Type Decision 

[0046] The splicing of bitstream Bq to bitstream Aq dsrupts the GOP structure. Thus the following rules are applied. 
5 The bit stream, In this example Aq , before the splice. Is recoded so that: 

(1 ) the last T or 'P* frame before the splice is converted to *P‘; 

(2) if the last frame before the splice Is a 'B' frame. It Is converted to 'P*. 

The bitstream, in this example Bq, after the splice Is recoded so that 

(3) the first T or 'P' frame after a splice is converted to T; and 

75- * (4) if the first GOP after the spice and after the application of rule (3) contains less than three frames, the 

T frame of the subsequent GOP is converted to *P', thereby changing the length of the GOP. In this example 
the GOP Is lengthened. 

[0047] A new transitional GOP begins with an l-frame immediately after the splice, and the new GOP Is made 
20 longer than preceding (and succeeding) GOPs in the bitstream Bq. The new GOP is in effect a prediction of where 
. .. ...V^VJock is to be achieved. The applbation of these rules is shown in Figure 7 at (1), (2), (3) and (4). 

' [(i046] In Figure 7 

A is bitstream Aq, 

B is bitstream Bq, and 

C Is the spliced bitstream at output C of encoder 4 as if the picture type decisions have not been made, and 

30 \ is the spliced bitstream at output C of encoder 4 with the picture type decisions applied to it 

[0049] By application of rule (2), the 'B* frame of Aq immediately before the splice is converted to P. By application 

;,of rule (1 ) the I frame of Aq before the splice is also converted to P. 

[0050] By application of rule (3), the first 'P* frame of stream Bq after the spfice is converted to I in stream C\ 

35 [0051] By application of rule (4), the GOP of bitstream Bq after the splice has (after conversion of its first P frame 

:* to I) less than 3 'P' frames. Therefore the next T frame is converted to 'P'. Application of these rules gives a GOP which 
defines a predicted VBVJock point as will be discussed below. 

. , [0052] . Rule 4 may be changed to (4^ ). 

40 (4^) If the first GOP after the splice contains only one ’P‘ frame, the frame types of the next GOP are altered from 

T to 'P’ and 'P' to T to give two ’P’ frames in a GOP. This results in two shorter GOPs between the splice point and 
^ VBVJock. 

Processing Order 

45 

[0053] Figure 7 shows the frames of the bitstreemns in the order in which they are displayed or would be displayed. 
Rgure 8 shows the order in which the frames are processed. For example, referring to Rgure 7 (Display Order) frame 
0, 1 and 2 of bitstream A are shown in that order. Even though the B frames 0 and 1 would be displayed before I frame 
2, they depend on I frame 2 to be decoded. Thus to decode them I frame 2 must precede the B frames as shown in 
50 ' Rgure 8. Likewise B frames 3 and 4 of Figure 7 depend on P frame 5 of Figure 7; thus in Rgure B P frame 5 of Figure 
7 becomes P frame 3 preceding the two B frames. 

Constant bit rate 

55 [0054] The example of the processor P of Figure 3 or 6A or 6B, has a constant bit rate. The bitstreams Aq Bq have 

a fixed bit rate and the encoder 4 produces at output C a constant bit rate. 
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Downstream Decoder and Buffer 

i _ 

[0055] The downstream decoder 2 has a buffer 8. The encoding which takes place In encoder 4 of the processor is 
arranged so that the buffer 8 of the downstream decoder 2 neither underflows nor overflows. Figures 9, 10 and 1 1 show 
s the operation of the downstream tmffer 8 of the downstream decoder 2. 

[0056] (The encoder 4 has a corresponding buffer and it operates as the Inverse of what is shown In Rgures 9, 10 * 
and 11,) 

[0057] The following are known MPEG rate control parameters. 

10 VBV 

[0058] VBV is virtual buffer verifier. It Is a measure of the number of bits that would be in the downstream buffer 8. 
RemaIn_blt_GOP 

15 

[0059] This is a target number for the total number of bits for the remainder of the current GOP. At the beginning of ; 
a GOP It Is a target for the whole GOP. It reduces as the GOP progresses. 

Complexity X, constants Kp, Kb and N, Np, Nb 

20 f 

[0060] N is the number of pictures in a GOP 

[0061] Np is the number of P frames remaining in a GOP. 

[0062] Nb is the number of B frames remaining in a GOP. 

[0063] Kp and Kb are 'universal' estimates dependent on quantisation matrices. They (indirectly) define the relative 
25 sizes of I, P and B frames. 

[0064] Xi, Xp. Xb are "complexity measures" for I, P and B frames. 

[0065] These parameters are used In a known manner to distribute the bits of a GOP amongst I, P and B frames. 
[0066] They are further explained in “Test Model S" published by "International Organisation for Standardisatton ^ 
Organisation Internationale De Normalisation Coded Representation of Picture and Audio Information ISO/IEQ' 

30 JTC1/SC29/WG11/N0400". 

Achievi ng VB V_Lock 

[0067] As discussed above, the downstream buffer must neither underflow nor overflow. In MPEG-2 the buffer is 

35 normally kept approximately half-full. A discontinuity in the bit stream can make the buffer underflow or overflow. VBV 

is the measure of buffer occupancy. \ 

[0068] Figures 9, 1 0 and 1 1 show, as an extreme case, buffer occupancy VBV for two bitstreams A© and B©. A© has 

a typical occupancy and Bq has unusually high occupancy. 

[0069] In the situation where the bitstream begins with A with typical occupancy, and B with high occupancy is 
40 spliced onto A at the splice point, it is necessary to provide, after the splice point, a transitional GOP or GOPs whk^r . . 

a) provides continuity, albeit changing, of VBV occupancy; and 

b) changes the VBV occupancy from the value of stream A just before the splice to a target value which is the value 
45 of VBV for stream B. 

[0070] As shown in Rgures 9. 10 and 1 1 . the VBV of bit stream C begins identical to A, then changes progressively 
towards the VBV of B. * ' • 

[0071] The point at which the VBV occupancy of C becomes identical to that of stream B is the VBVJock point ‘ 

50 [0072] As mentioned above Rgures 9, 1 0 and 1 1 show occupancy of the downstream buffer 8. To achieve 

VBV_lock the encoder 4 is controlled as follows. 

Methods of Achieving VBV Lock 

55 a) Picture Decision Rules 

[0073] The methods use the picture decision rules (1) to (4) above. 
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b) Complexity 

W- - ‘ 

[0074] For the system of Rgure 3 stream A is decoded and re*encoded before the splice. Thus encoding occurs 
- ^with cbmpl^^ values appropriate to stream A. However, these values are not appropriate for stream B. Thus before 
5 '' .the splice, complexity values Xj, Xp Xg of the I, P and B frames of stream B immediately before the splice are calculated 
based on 




■, where 
X = complexity value 



.. S = number of bits generated by encoding picture 

15 ' ; 

O = average quantisation parameter of all macroblocks in a picture. 



p075] X = S.Q is a standard equation for rate control in MPEG. 

jp[>p76] For the system of Rgure 6, because the bitstreams to be spliced A| and B| comprise only l-frames, the com- 
20 pl^ity estimates are derived as follows: 



a) for P and B frames from the first generation transcoding parameters (which have been retained in association 
with the frames) of the I frames of the bitstream B| after the splice point; and 

V b) for the l-frames from any l-frame of stream B| after the splice point. Preferably, the l-frame chosen Is one which 
will be recoded as an l-frame in stream C. 

{0077] These frames may be available at the splice point due to the 3-frame re-ordering delay. Otherwise a 3-frame 
delay may be provided. 

30 [0078] In both systems, at the splice point these complexity values replace the existing values (of stream A). So 

. after the splice complexity values appropriate to stream B are used. As discussed above, in the system of Figure 6, the 
complexity values are derived from the stream B after the splice point 

[0079] The complexity values control the distribution of bits amongst I, P and B frames. Achieving good subjective 
quarity is dependent on the complexity values.. 

35 ■ 

c) Virtual Buffers Modification 

[0080] The virtual buffers are used to calculate the reference Q scale for each macroblock. Improvement in quality 
^ : can be gained by setting the virtual buffers to estimated stream B values at the splice point. This ensures that the resuft- 
40 Ing Q scales are similar to those used in stream B in the previous generation, instead of continuing with stream A Q 
scales. 

[0081] For the system of Rgure 3 stream B virtual buffer values are estimated for the last I, P and B frames before 
the splice point, based on Q. 

[0082] For the I frame, the value is calculated as: 

45 

estimated_buf J = (Q * bit_rate) / (31 * frame_rate). 



50 



[0083] Q is the average quantisation parameter. 

[0084] This value is then forced at the splice point 

[0085] This is also done for the P and B virtual buffers in same way. 

[0086] For the system of Rgure 6 because the bitstreams to be spliced A| and B| comprise only l-frames. the virtual 

buffer estimates are derived using the value estimated_buf_i set out above but deriving its value as follows: 



a) for P and B frames from the first generation transcoding parameters (which have been retained in association 
55 with the frames) of the I frames of the bitstream B| after the splice point; and 



b) for the l-frames from any l-frame of stream Bj after the splice point. Preferably, the l-frame chosen is one which 
will be recoded as an l-frame in stream C. 
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[0087] The frames are available because they are stored, for example for the purpose of reordering the frames. ' ' 

[0088] The encoding in encoder 4 is controlled in accordance with Remaln-bit-GOP, between splice and VBV_k^,.‘ 

so that the occupancy of the downstream buffer 2 follows a continuous but changing trajectory from before the splice: ttV ' 
bitstream A occupancy to VBVJock at the bitstream B occupancy. The control is also used to force the complexity and 
5 virtual buffers as described above. The control which does that is a 'rate controP and is known in for example from the 
paper Test Model 5* mentioned above. 

d) Adjust Remaln_bIt_GOP. 

’-'.yi* 

10 [0089] In order to increase occupancy of the downstream buffer as shown in Rgure 9, the buffer in the encoder is ^ 

controlled in accordance with Remain_bit_GOP to output pictures with smaller numbers of bits, so that its occupan^ . . 
decreases. Pictures with smaller numbers of bits are produced by Increased compression/coarser quantisation. - ^ 
[0090] If the trajectory is from high occupancy of the downstream buffer to lower occupancy of the downstream 
buffer, the encoder is controlled in accordance with the higher Remain_bit_GOP to increase occupancy of its buffer,: . 

15 producing larger pictures by less compression/finer quantisation. ^ : 

Remain_bit_GOP is the target for the number of bits remaining in the GOP. 

[0091] The length of the transitional GOP is known from the result of adjusting the GOP length using the picture " 

20 decision rules (1 ) to (4) above. 

[0092] Remain__bit_GOP is adjusted In the following way. It is reduced after every frame by the number of bits used - 
to encode that frame as is normal in MPEG2. In addition referring to Figures 12 A, B and C, it is updated at the start of ' 
the transitional GOP and on every I or P frame therein as described with reference to Rgures 12 A to C. 

[0093] At the splice point, Remain^bit _GOP Is set to the normal allocation of bits for the transitional GOP defined ^ 
25 by the picture decision rules, the allocation being preferably reduced by the factor a. a variable carry_over Is set to zero 
and a variable reduction^carry is set to zero. (Step SI]. (Canry_over is a positive value of VBV^diff averaged over thd 
remaining I and P frames of the GOP and reduction_cany is the excess of VBV_diff over the reduction_limlt) ' 

[0094] A variable Reduction Jimit is Initially set to 

30 minus (bitrate * remain_num_total * max_red_% )/ (frame_rate) . : 

where 

remain_num_total is the number of frames remaining in the GOP, and •' 

35 max_red_% is a number chosen empirically representing the desired maximum reduction in bit rate allowed during 
the transitional GOP. [StepS2]. Reductionjimit represents the maximum amount by which the bit rate may- be 
reduced at any update on an I or P frame. ' ' 

t \ 

[0095] VBV_diff for the start of the transitional GOP is calculated as 

40 

(VBV_C_spIlce) - (VBV_B_next_l or P) 

i.e. as the difference between the VBV value of bit stream C at the splice point and the VBV value of the bitstream 
B at the immediately following I or P frame. [Step S31 ]. -.v- 

45 [0096] It is to be appreciated that reductionjimit is a negative number in this example. Also steps SI , S2 and S3t . 

set up Initial values used only at the start of the transitional GOP. 

[0097] Referring to step S4, step S4 determines whether the initial value of VBV^diff at the start of the GOP is pbs-. 
itivo or negative as calculated by step S31 . If the update is taking place on an I or P frame not at the start of the C^P 
then VBV_diff is calculated by step S32 as ‘ 

50 

VBV_diff = (VBV_B_ Current I or P) - (VBV_B_next I or P) + reduction_cairy. 

[0098] That is VBV_diff is updated by the difference between the current VBV value of the bitstream B and the next 
VBV_value (on em I or P frame) plus any reduction_carry. 

55 [0099] Updates then take place in the following way which applies equally to the start of the GOP and to subse- 

quent updates on an I or P frame. 
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- 

•>>yi3Vldlff positive at Step S4, (See Rgure 12B) 

/vl'* * 

' . [dlOO] If VBV_diff is positive, then step S5 increments the variable carry_over by 






(VBV_diffy(number of I or P frames remaining in the GOP) 



and step S6 increments Remain_bit_ GOP by carry_over. Thus steps S5 and S6 average positive values of VBV_diff 
oyer the remaining I and P frames in the GOP. On each occasion there is a positive VBV_diff Remain_bit_GOP is incre- 
‘ ' mented by carry_over. 

10 [(^01] Step S7 sets reduction Jimit to: 

.'k . . 

‘"-4 • (Reductionjimit - carry_over) * (next_remain_num_total) / (remain_num_total) 

r-'; vvtiene next_remain num_total is the number of frames remaining in the GOP at the next update (at an I or P frame) 
15,.. including the next I or P frame and remain_num_total Is the number of frames remaining in the GOP including the cur- 
frame. That is the negative value reductionjimit Is increased by carry_over because the positive change in 
5 1^emaln_bit_GOP allows a bigger change In VBV at a subsequent update. 

[0102] Step S8 sets reduction_carry to zero: reduction_carry is recalculated at each update on an I or P frame to 
.. avoid accumulation of its values. 

VBV.diff negative at Step S4. (See Rgure 1 2B). 

V fWOSj If VBV_diff is negative at step S4, then at step S10, the variable carry_over (which is the cumulative aver- 
J aged positive value of VBV.diff from previous updates calculated at step S5) is added to VBV^diff to produce a new 
^ue of VBV_diff. That is carry_over is added to VBV_diff to make It less negative thus allowing a correspondingly big- 
ger change to occur in Remain_bit_GOP because more bits are available. The result as tested at step S1 1 is that the 
• . new value of VBV_diff may be more or less negative than reductionjimit which is the maximum change allowed in 
' * ;RemaJn_bit_GOP. 

[0104] If the new value of VBV_diff is more negative than reduction_fimit then Remain_bit_ GOP is reduced by 
30 reductionjimit [step SI 5]. Reduction_carry is calculated at step S16 as the excess of the new value of VBV_diff over 
the reductionjimit Once reductionjimit has been exceeded in the GOP it is set to zero at step SI 7. 

' p105] If the new value of VBV_cfrff is less negative than reductionjimit then at step S12 Remain_bit _ GOP is 
changed by the value of VBV_diff. It will be appreciated that the new value of VBV_diff could be positive or negative in 
this case. If VBV_cfrff is positive Remain_bit _GOP is increased by VBV_diff and if VBV_Diff is negative 
35 Remain_bit_GOP is reduced by VBV_diff. 

’ [0106] At step SI 3, the reduction_limit is set to: 

(reductionjimit ‘VBV_diff) * (next_remain_num Jotal) / (remain_numJotal) 

40 - where next_remain_num Jotal and remain_numJotal are as defined for step S7. That is reductionjimit is: 

reduced (i.e. made less negative) as the GOP progresses if VBV_diff is negative because fewer bits are available 
in the GOP; and ( subject to the scaling effect of (next_remain_numJotaJ) / (remain_numJotaI) increased (i.e. 
made more negative) if VBV_diff is positive because more bits are available In the GOP. 

45 

[0107] Reduction^carry is set to zero at step SI 4 for the same reason as at step S8. 

[0108] The algorithm then proceeds to the next I or P update at step S9. If at step SI 8 the end of the transitional 

^ GOP as determined by the picture decision rules has not occurred then the procedure returns to step S32 and repeats 
until the end of the transitional GOR 

so [0109] At the end of the GOP. step S19 determines whether reduction^carry is more negative than a threshold 
value reduction carry threshold. It will be appreciated that this will occur only if VBV_diff is more negative (after any pos- 
itive offsetting by the cumulative value cairy_over) than reduction limit. 

[0110] Reduction_caiTy less negative than the threshold indicates that VBVJock can be achieved using stuffing 
bits as at step S22. The next GOP is then started with reuse of the transcoding parameters to maintain picture quality. 
55 [0111] Reduction^carry more negative than the threshold indicates that VBV_lock has not been achieved and a 

new transitional GOP is started but with reuse of the I frame transcoding parameters and recoding of P and B frames. 
[Step S20]. For the new transitional GOP the following variables are set to initial values at the start of the GOP: 

[0112] Remain_bit _GOP is set to its normal allocation. The length of the GOP is not determined by the picture 
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decision rules but is detennined as the normal length for a GOR Carry_over is set to zero. Reduction_limit is setflo 
minus (bitrate * remain_num_total * max_red_%) / (frame_rate) . . 

[0113} The value of reduction_carry from the previous GOP Is carried over to the new GOR 

[0114] The procedure of updating Remain_bit GOP of steps S32 and S4 to SI 8 starts again until the occupancy of' ^ 

5 the transittonal GOP equals that of the bitstream B. Preferably, the new transitional GOP reuses transcoding param^ 
ters for its I frames. 

[0115] In one version, the threshold is set at zero. If reduction^carry is zero, the transitional GOP ends because 
VBVJock is deemed to have occurred. If reduction_canry is not zero, full recoding continues In another GOP, which is ’ 
a normal long GOP but according to the procedure of Figure 12 until VBV_Iock is achieved.. 

10 [0116] In another version, the threshold is set to a value K%. If reduction_carry is less than K then any difference 

between the VBVs of the transitional GOP and the bitstream B are small and are made up with stuffing bits. The spare . 
stuffing bits are from the allocation of spare bits provided by reducing the normal allocation for Remain_blt_GOP by the .; 
factor a at the beginning of the GOP. The threshold K % is of the normal bit allocation for a long GOR K may be in thd- 
range 0% to 8%, preferably about 5%. The maxlmum_reduction_j>ercentage may be 25%. 

IS [0117] The application of the reduction Jimit ensures that during the transitional GOP the bit rate does not go below. , 

a predetermined minimum rate or equivalently the rate of change of occupancy does not exceed a predetermined maSc- • 
imum rate. Dividing positive changes in Remain_blt_GOP over the remainder of the I and P frames in the GOP tends 
to even out the changes in Remain_bit_GOP over the GOR If VBV_diff is negative, but does not exceed the reduction’ 
limit, the limit is progressively reduced as the GOP proceeds. Thus the maximum change allowed reduces preventing, ' 
20 disproportionately large changes in Remain_bit GOP at the end of the GOP. The method of Figure 1 2 allows the tram ^ 
stion region beginning just before splice and ending at VBVJock to be varied in length as necessary (as determined by 
reduction Jimit) so as to efficiently achieve VBVJock. 

VBV_Lock point 

25 - h :??: 

[0118] The period over which VBVJock is predicted to be achieved is one (or more) GOP albeit a GOP the length 
of which may have been changed by the picture type decision rules. In this example it is about 30 frames. 

[01 1 9] Referring to Figures 2, 3, 4, 5 and 6, assume lock is achieved at l-frame 52 in display order (Figure 4). In feet 

the VBV lock is achieved in the pmcessing order so that it occurs at reordered I frame 50 (Rgure 6). The following B 
30 frames 51 and 52 in Rgure 5 are fully recoded frames from prior to VBVJock and disturb the lock. Thus the spare bitsf 
are used at the second B frame 52 to stuff the bitstream to achieve exact lock. =: . 

[0120] If the factor a is zero, then no spare bits are available so the system attempts to achieve exact lock at the I 
frame immediately after the end of the transitional GOP. Rate control under or over steers producing usually too many 
bits. Even if exact lock is achieved, at the I frame, lock is disturbed at the B frames. So. Remain_bit-GOP is reducedby ’ * 
35 the factor a so rate control oversteers so that spare bits are available at the end of the GOP. The spare bits are usetfto . 
achieve exact lock at the second B frame. V 

[0121] The l-frame 50 is processed by reusing its parameters derived from the original bitstream Bq. In the system 
of Rgure 6, after the fully recoded B frames 51 and 52, re-use of parameters resumes. In the system of Rgure 3, the 
recoding with reuse resumes until the original bitstream is directed directly to the output of the processor bypassing the 
40 decoding and re-coding. 

Motion Vectors 

[0122] Motion vectors are regenerated for the transitional GOR Alternatively motion vectors could be estimated 
45 from vectors in neighbouring frames. 

Bit growth on frames outside transition region 

[0123] In the system of Rgure 6, the VBV values of the recoded frames are only approximately the same as their 
so original forms because the number of bits may shrink or grow in the course of decoding and recoding. 

[0124] The frames outside the transition region are originally encoded as long GOPs, decoded to basebartd 
recoded as I frames, decoded to baseband and recoded as log GOPs. In these processes, the transcoding parameters 
of the original encoding are re-used to maintain maximum quality. However the DCT and inverse DOT (IDCT) processes 
are not transparent, i.e. errors occur. In addition, the original baseband is not the same as the decoded I frames due to 
55 quantization effects. As a result the number of bits in the frames can shrink or grow. If the shrinkage or growth is large . 
enough the buffers may over-or under-flow. Thus, the frames are monitored. 

[0125] If excessive shrinkage occurs bit stuffing is used. If excessive growth occurs; frames are recoded. Thebit 
stuffing and recoding is used to maintain occupancy within normal MPEG2 limits. Preferably recoding reuses the trari^ 
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. coding paramters of the I frames to maintain picture quality. 



•2 : Claims 

5 1. A signal processor for splicing a compressed bitstream Bq to a compressed bitstream Aq, comprising 





means (1 , 2) for decoding the bitstreams Aq and Bq, switching means (S2) coupled to the decoding means (1 , 
2) for producing a spliced bitstream C, comprising data from bitstream Bq spliced to data from bitstream Aq at 
a splice point (SPLICE) 

encoding means (4) for re-encoding the spliced bitstream C for supply to a downstream decoder (2) having a 
downstream buffer, wherein the encoding means (4) is controlled over a transitional region so that the occu- 
. pancy of the downstream buffer varies over the transitional region from the occupancy of bitstream Aq to the 
occupancy of bitstream Bq according to a trajectory in which the rate of change of occupancy is limited to a 
predetermined maximum rate. 

A processor according to claim 1 , wherein the occupancy within the transitional region is changed at predetermined 
intervals. 



. 3/ A processor according to claim 2, wherein the change at each interval is limited to a predetermined maximum 

20 ; • amount 

•T-' 

A processor according to claim 1 , 2 or 3 wherein the compressed bitstreams Aq and Bq are compressed video bit- 
stresuTis. 

25 5 . A processor according to claim 4, wherein the bit streams are compressed according to MPEG2. 

’ " : A processor according to claim 1, 2, 3, 4 or 5. wherein the switching means (S2) supplies to the encoding means 

a spliced bitstream C comprising decoded bitstream Bq spliced to decoded bitstream Aq (Figure 3). 



30 7 . A processor according to claim 6, wherein the bitstreams comprise G roups of Pictures (GOPs) having at least I and 

, P frames, wherein the transitional GOP is produced by recoding the bitstream Bq after the splice to form the bit- 
stream C so that the bitstream C has 

a) an I frame at the beginning of the transitional GOP following the splice point and, in addition to the said I 

35 frame, 

b) at least three P frames. 

^ 8. A processor according to claim 6 or 7, wherein the transitional region comprises a portion before the splice point 
. ’ produced by modifying stream Aq to form the re-encoded stream C so that 

40 

c) the last ‘I* or 'P' frame before the splice point is converted to R and 

d) if the last frame of bitstream A before the splice is a ‘B* frame, it is converted to P. 



9. A processor according to claim 6, 7 or 8, wherein the transcoding parameters of at least the I frames of the bit- 

45 streams Aq and Bq are reused when recoding the corresponding frames of the bitstream C at least outside the tran- 
sition region. 

10. A processor according to claim 9, wherein the transcoding parameters of ail frames of the bitstreams Aq and Bq are 
reused when recoding the corresponding frames of the bitstream C outside the transition region. 

50 

.11. A processor according to claim 1 , 2, 3, 4 or 5, further comprising means (8, 10) for re-encoding the decoded bit- 
streams Aq and Bq as bitstreams A| and Bj respectively comprising only I frames, the ericoding means (4) re-encod- 
ing the bitstreams A| and B| to form the spliced re-encoded bitstream C. 

55 12. A processor according to claim 1 1 , wherein the bitstreams comprise Groups of Pictures (GOPs) having at least I 

and P frames, wherein the transitional GOP is produced by recocfing the bitstream B| after the splice to form the 
bitstream C so that the bitstream C has 
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a) an I frame at the beginning of the transitional GOP following the splice point, and, in addition to the said I V 

frame, ' 

b) at least three P frames. ' ’ 

5 13. A processor according to claim 11 or 12. wherein the trarisrtional region comprises a portion before the splice poioi / 

produced by modifying stream A| to form the re-encoded stream C so that referring to the frames of bitstream 
corre^ondlno to the frames of bitstream Aj 

. \ 

c) the last or ’Pg’ frame before the splice point is converted to P, and ^ • 

^ the last frame of bitstream Aq before the splice is a *B' frame, it is converted to R 

1 4. A processor according to claim 1 1 , 1 2 or 1 3, wherein the transcoding parameters of at least the I frames of the bit- 

streams Ag and Bg are reused when recoding the corresponding frames of the bitstream C at least outside the tr^ • 
sitional region. T 

T5 

15. A processor according to claim 14, wherein the transcoding parameters of at least the I frames of the bitstreams A^ 
and Bg are reused when recoding the corresponding frames of the bitstream C at least outside the transition region. 

16. A processor according to any one of claims 6 to 15, wherein the encoding means (4) calculates for the transitional 

20 GOP after the splice point a target number of bits Remain_bit_GOP for the GOP. and controls the occupancy of the " 

downstream buffer by bitstream C within the transitional GOP in dependence upon Remain_bit_GOP and limits the ’ 
rate of change of occupancy of said downstream buffer to the said predetermined maximum rate. 

.Vr/ 

17. A processor according to claim 16, wherein Remain_bit_GOP is recalculated at regular intervals. 

25 • ■ - 

18. A processor according to claim 17. wherein the said regular intervals are every 3 frames, at frames of the transl-^' 
tional GOP corresponding to I frames and/or P frames of the bitstream Bg after the splice. 

19. A processor according to claim 18, wherein at the beginning of the transitional GOP. Remain_brt_GOP is calculate 

30 as an initial value which is the normal allocation of bits calculated for the transitional GOP. 

20. A processor according to claim 19, wherein at the beginning of the transitional GOP, the normal allocation is . ' 
reduced by a factor a where a is less than one. 

35 21. A processor according to claim 19 or 20, wherein the a value VBV_diff is calculated in respect of the splice point 

where VBV_diff is dependent on the difference between the values of occupancy of stream C at the splice pbiht ’ 
and the occupancy of bitstream Bg at a frame adjacent the splice point. ■ 

22 . A processor according to claim 21 , wherein subsequently at the said regular intervals the value VBV_diff is depeind- 

40 ent on the difference between the occupancy of bitstream B at the current frame of the transitional GOP and the 

occupancy of bitstream Bg at the next Interval Is calculated. 

23. A processor according to claim 21 or 22, wherein if VBV_diff is positive Remain_bit_GOP is incremented at each ^ 
recalculation thereof by a value carry_over ={VBV_diff)/(n umber of recalculation Intervals remaining In the GOP) f * 

45 

24- A processor according to claim 23 wherein carry__over is added to VBV_diff on each recalculation of VBV_diff. 

25. A processor according to claim 21, 22, 23 or 24, wherein if VBV_diff is negative, but is not more negative tharj. a 
limit value, then Remain_bit_GOP is reduced by VBV_diff. 

so • 

26. A processor according to claim 25, wherein the limit value is reduced by a value proportional to VBV_diff.. 

27. A processor according to claim 26, wherein the limit value is reduced by VBV_diff*R, where R is a predetermined 
value less than one. 



28 . A processor according to claim 27, wherein R is number of recalculation intervals remaining in the GOP divided by 
the total number of recalculated intervals in the GOP. 
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29. A processor according to claim 24, 25, 26, 27 or 28, wherein if VBV_diff is more negative than the limit value, 
« Remain_bit_GOP is reduced by the limit value. 

30. A processor according to claim 29, wherein a value reduction_carry equal to the excess of VBV_diff over the limit 
5-. , V . value is calculated. 

3T. A processor according to claim 25. wherein once reduction Jimit exceeds the limit value, the limit value is set to 
' zero for the remainder of the transitional GOP. 

10 : - 32; A processor according to claim 28, 29 or 31 , wherein if the value of reduction_carry at the end of the transitional 
GOP is greater than a threshold value, then in the following GOP the occupancy of the downstream buffer is con- 
trolled In dependence upon Remain_bit_GOP until the value of reduction_cany equals or is less than the threshold 
value. 

15 33. A processor according to claim 32, wherein the said threshold is zero. 

: ; 34» A processor according to claim 32, wherein the said threshold Is 

K*( normal allocation of bits ina GOP), where 0<K<1 . 

20 - ^ 

35. A processor according to claim 34, wherein 0<K<0.1 , preferably 0.01. 

V 36. A processor according to claim 32, 33, 34 or 35, wherein if reduction^carry is less than the threshold but the occu- 
pancy of bitstream C does not equal that of B, additional bits are added to C to achieve equality. 

25 j;. 

37 . A signal processor for splicing a compressed bitstream B to a compressed bitstream A. each bitstream comprising 
groups (GOPs) of I, and P and/or B frames comprising 

means (1, 2) for decoding the bitstreams Aq and Bq, 

switching means (S2) coupled to the decoding means (1 , 2) for producing a spliced bitstream C, compris- 
ing data from bitstream Bq spliced to data from bitstream Aq at a splice point (SPLICE), and 

encoding means (4) for re-encoding the spliced bitstream C for supply to a downstream decoder (2) having a 
downstream buffer, wherein 

the encoding means (4) is controlled over a transitional region so that the occupancy of the downstream buffer 
varies over the transitional region from the occupancy of bitstream Aq to the occupancy of bitstream B©, 
the transitional region includes a transitional GOP extending from the splice point and of a length which is an 
initial prediction of the point in stream B at which the occupancy of stream C equals that of stream B, and occu- 
pancy is changed at regular intervals in the GOP according to a trajectory so as to make the occupancy of 
stream C equal to that of stream B by the end of the GOP, 

a limit is applied to a change according to the trajectory which increases occupancy, and 
the amount by which the change would exceed the limit (if it were not limited) is compared at the end of the 
GOP with a threshold and, if it exceeds the threshold, the transitional region is extended. 

45 

, 38. A system according to claim 37, wherein the limit is progressively reduced as the GOP progresses. 

39- A system according to claim 38, wherein the limit is progressively reduced provided it is not exceeded. 

50 40. A system according to claim 37. 38 or 39, wherein a change which reduces occupancy at one of the said intervals 

is averaged over the remainder of the GOP. 



30 
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